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DETAILED ACTION 

Priority 

1. Receipt is acknowledged of papers submitted under 35 U.S.C. 1 1 1(b), which papers have 
been placed of record in the file. 

Information Disclosure Statement 

2. The reference listed on the disclosure statement (IDS) submitted on 01/21/2005, 04/06/2007 
and 07/03/2007 have being considered by the examiner (see attached PTO 1449). 

Drawings 

3. The drawings are objected to because labeled element "50" in the Baggage Claim area in 
Figure 3 has been mislabeled. The labeled element "50" should be changed to "58" (see 
[0033]). Corrected drawing sheets in compliance with 37 CFR 1.121(d) are required in reply 
to the Office action to avoid abandonment of the application. Any amended replacement 
drawing sheet should include all of the figures appearing on the immediate prior version of 
the sheet, even if only one figure is being amended. The figure or figure number of an 
amended drawing should not be labeled as "amended." If a drawing figure is to be canceled, 
the appropriate figure must be removed from the replacement sheet, and where necessary, the 
remaining figures must be renumbered and appropriate changes made to the brief description 
of the several views of the drawings for consistency. Additional replacement sheets may be 
necessary to show the renumbering of the remaining figures. Each drawing sheet submitted 
after the filing date of an application must be labeled in the top margin as either 
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"Replacement Sheet" or "New Sheet" pursuant to 37 CFR 1.121(d). If the changes are not 
accepted by the examiner, the applicant will be notified and informed of any required 
corrective action in the next Office action. The objection to the drawings will not be held in 
abeyance. 



Specification 

4. The specification has not been checked to the extent necessary to determine the presence of 
all possible minor errors. Applicant's cooperation is requested in correcting any errors of 
which applicant may become aware in the specification. The table below shows just a few of 



the many minor errors through the specification: 



Page no 


Line no 


Mislabeled character 


Corrected character 


12 


14 


108 and agent 108. 


108 and agent 106. 


14 


24 


communication line 103 


communication line 1 13 


15 


4 


passport-checking agent 158 


passport-checking agent 138 


16 


7, 10 


Section 104 


Section 102 


16 


18 


captured video mage 


captured video image 


16 


22 


a traveler 146 


a traveler 118 


18 


8,9 


95, 97, 99, 101 


95,97, 99, 101,113,133 


18 


22 


176, 160, 162. 


174, 160, 162. 


24 


24 


to the travel 182 


to the travel 206 


30 


27 


memory device 254 


memory device 252 


35 


26 


At step 352 


At step 350 



Claim Rejections - 35 USC § 103 
5. The following is a quotation of 35 U.S.C. § 103(a) which forms the basis for all obviousness 
rejections set forth in this Office action: 
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(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

6. Claims 1-17 and 19-43 are rejected under 35 U.S.C. § 103(a) as being unpatentable over 
Waters (US 6,396,535) in view of Houvener (US 6,757,408). 

Regarding claim 1, Waters discloses an apparatus (situation awareness system) for the 
analysis of a captured image, the apparatus comprising: 

- an at least one first station (camera 101, Fig 1) for capturing an at least one first 
image along a traveler path (arrow 301 shows the direction of movement of 
objects, i.e. vehicle, pedestrian, other traffic, and so forth) (col. 3, lines 53-67); 

- an at least one second station (camera 102, Fig 1) for capturing an at least one 
second interaction along the traveler path (col. 3, lines 53-67); and 

- an analysis device (an analyzer synthesizer 200, Fig 1) for comparing the at least 
one second interaction (camera 102, Fig 1) with the at least one first interaction 
(camera 101, Fig 1) (col. 2, lines 46-58 and Figs 1-2). 

Waters does not specifically teach an apparatus for the analysis of a captured interaction 
associated with a traveler and an agent. However Houvener does teach an apparatus (security 
identification system) for the analysis of a captured interaction associated with a traveler and 
an agent (provides high quality data capture and screening by leveraging the interaction 
between screening personnel , i.e. an agent and people being screened , i.e. a traveler) (col. 6, 
lines 5-12). 
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Thus, it would have been obvious to one of ordinary skill in the art to have included the 
security identification system as taught by Houvener into Waters' system, as the combination 
yields a systematic, uniform, natural, efficient and optimal data collection process and 
increases the likelihood of detecting a known high-risk individual, and minimizes the number 
of false positive identifications, thus the system provides a safeguard that ensures that each 
passenger boarded a plane, that their luggage is on the plane, and that the luggage is later 
claimed by the correct person (col. 6, lines 13-24, Houvener). 

Regarding claim 2, Waters discloses a control station (analyzing synthesizer 200, Fig 1) 
for storing the at least one first and second interactions captured (col. 2, lines 46-58). 

Regarding claim 3, Waters discloses an alarm identifier device (analyzing synthesizer 
200, Fig 1) for identifying an alarm situation (certain dangerous situation or event are 
recognized) based on the comparing of the at least one second interaction with the at least 
one first interaction (multiple attributed objects are analyzed to detect events) (col. 2, line 46 
to col. 3, line 2). 

Regarding claim 4, Waters discloses an alarm-generating device (an output device 150, 
i.e. a bell, Fig 1) for generating an alarm (alerts 252, Fig 2) associated with an alarm situation 
(certain dangerous situation or event are recognized) identified by the alarm identifier device 
(analyzing synthesizer 200, Fig 1) (col. 2, line 46 to col. 3, line 2). 

Regarding claim 5, Waters discloses a station poll data device (analyzing synthesizer 200, 
Fig 1) for polling stations (video streams 115, Figs 1-2) for the at least one first and second 
interactions (multiple video cameras 101-106, Fig 1) (col. 2, line 46 to col. 3, line 12). 
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Regarding claim 6, Waters discloses a station transfer data device (analyzing synthesizer 
200, Fig 1) for managing data (extracting temporal and spatial data from the video streams to 
identify objects and their attributes) transferred from stations for the at least one first and 
second interactions (multiple video cameras 101-106, Fig 1) (col. 2, lines 46-58). 

Regarding claim 7, Waters discloses a database (partially attributed data objects 231, Fig 
2) for storing and retrieving the at least one first and second interactions (col. 3, lines 18-42). 

Regarding claim 8, Waters discloses a replay device (output device 120, Fig 1) for 
replaying at the least one first or second interactions (e.g. generating a synthetic display of 
multiple video cameras 101-106) (col. 2, lines 35-58). 

Regarding claim 9, Waters discloses an object tracking device (analyzing synthesizer 
200, Fig 1) for tracking an object within the at least one first or second interactions (various 
kinds of template matching schemes can be used to fully identify specific commonly 
occurring objects, such as, traveler and the like) (col. 3, lines 32-42). 

Regarding claim 10, Waters discloses at least one first and second stations (camera 101 
and 102, Fig 1) comprise at least one video capturing device (video cameras 101-106, Fig 2), 
an at least one audio recording device (synthesizer 250, Fig 2), an at least one data capture 
device (data analyzer 240, Fig 2), an at least one storage device (secondary data 238, Fig 2) 
and an at least one data retrieval device (data render 260, Fig 2). 

Regarding claim 11, Waters discloses at least one first station and second station are 
located in the same transportation port (e.g. multiple cameras can be arranged to obtain a full 
field of view of an area of interest) (col. 2, lines 21-28). 
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Regarding claim 12, Waters discloses at least one first station and second station are 
located in remote transportation ports (e.g. a camera can transmit the data element from/to a 
remote location) (col. 4, lines 17-26). 

Regarding claim 13, Waters discloses a second control room for recording and storing the 
at least one first and second interactions (e.g. image data of camera can transmit the data 
element from/to a remote control location) (col. 4, lines 17-26). 

Regarding claim 14, Waters discloses a local or remote operator for observing the 
operation of the apparatus (the apparatus can be under user control and the user can supply 
control signal to the system) (col. 4, lines 17-26). 

Regarding claim 15, Waters discloses the control station comprises a recording and 
retrieval system (information extracting from digital video data 201, data generating by 
analyzer 240, and data converting by synthesizer 250) (col. 3, lines 4-51). 

Regarding claim 16, Waters discloses the capturing is performed in real time to be 
analyzed upon capture (operating in real-time) (col. 2 lines 46-58). 

Regarding claim 17, Waters discloses the transportation port is an airport (col. 4 lines 27- 
30). 

Regarding claim 19, Waters discloses at least one and second interactions comprise a 
captured data, video and audio (video cameras 101-106, Fig 2, audio synthesizer 250, Fig 2, 
and data analyzer 240, Fig 2) depicting the interaction between the agent and the traveler (an 
event 242 generated by analyzing the relationships among the attributed objects, e.g. between 
a agent and a traveler) (col. 3, lines 4-51). 
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Regarding claim 20, the limitations of claim 1 are taught above, Houvener discloses a 
quality assurance device (an interactive multi-media training module of the identity 
verification system) for analyzing the at least one first or second interaction for analyzing the 
quality of service provided to the traveler by the agent (provides high quality data capture 
and screening by leveraging the interaction between screening personnel, i.e. an agent and 
people being screened, i.e. a traveler) (col. 6, lines 5-12 and col. 8, line 36 to col. 9, line 6). 

Thus, it would have been obvious to one of ordinary skill in the art to have included the 
interactive multi-media training module as taught by Houvener into Waters' system, as the 
combination permitting a large organization to assure that their field personnel are providing 
high quality customer service in a method that is considerably more efficient and effective 
than sending them to the field foe auditing and training purpose (col. 8, line 36 to col. 9, line 
6, Houvener). 

Regarding claim 21, the limitations of claims 1 and 20 are taught above, Houvener 
discloses the quality assurance device (an interactive multi -media training module of the 
identity verification system) alerts a supervisor where the quality of service provided by an 
agent fails to meet a predetermined standard (immediately react to issue noted) (col. 6, lines 
5-12 and col. 8, line 36 to col. 9, line 6). 

Regarding claim 22, the limitations of claims 1 and 20 are taught above, Houvener 
discloses the quality assurance device (an interactive multi-media training module of the 
identity verification system) initiates a training session with an agent (the field personnel are 
prompted to participate in a training session at the next convenient time such as at the start of 
their next shift) (col. 8, line 36 to col. 9, line 6). 
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Regarding claim 23, this claim differs from claim 1 only in that the claim 1 is an 
apparatus claim whereas claim 23 is a method. Thus the method claim 23 is analyzed and 
rejected as previously discussed with respected to claim 1 above. 

Regarding claim 24, this claim recites same limitations as claim 13. Thus it is analyzed 
and rejected as previously discussed with respect to claim 13 above. 

Regarding claims 25, 26, 27, 28, 29, 30, 31 and 32, these claims recite same limitations 
as claims 2, 3, 4, 5, 7, 8, 9 and 10, respectively. Thus they are analyzed and rejected as 
previously discussed with respect to claims 2, 3, 4, 5, 7, 8, 9 and 10 above. 

Regarding claim 33, this claim recites same limitations as claim 20. Thus it is analyzed 
and rejected as previously discussed with respect to claim 20 above. 

Regarding claims 34, 35, 36 and 37, these claims recite same limitations as claims 11, 12, 
13, and 15, respectively. Thus they are analyzed and rejected as previously discussed with 
respect to claims 11, 12, 13, and 15 above. 

Regarding claim 38, Waters discloses at least one and second interactions comprise a 
captured data, video and audio (video cameras 101-106, Fig 2, audio synthesizer 250, Fig 2, 
and data analyzer 240, Fig 2) depicting the interaction between the agent and the traveler (an 
event 242 generated by analyzing the relationships among the attributed objects, e.g. between 
a agent and a traveler) (col. 3, lines 4-51). 

Regarding claim 39, Waters discloses an alarm identifier device (analyzing synthesizer 
200, Fig 1) for identifying an alarm situation (certain dangerous situation or event are 
recognized) based on the comparing of the at least one second interaction with the at least 
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one first interaction (multiple attributed objects are analyzed to detect events) (col. 2, line 46 
to col. 3, line 2). 

Regarding claim 40, Waters discloses a local or remote operator for observing the 
operation of the apparatus (the apparatus can be under user control and the user can supply 
control signal to the system) (col. 4, lines 17-26). 

Regarding claim 41, this claim recites same limitations as claim 21. Thus it is analyzed 
and rejected as previously discussed with respect to claim 21 above. 

Regarding claim 42, this claim recites same limitations as claim 6. Thus it is analyzed 
and rejected as previously discussed with respect to claim 6 above. 

Regarding claim 43, Waters discloses a method for traveler interactions management (an 
event 242 generated by analyzing the relationships among the attributed objects, e.g. between 
a agent and a traveler) capturing information at predetermined locations along a traveler path 
(multiple video cameras 101-106 along the direction of movement of objects, Figs 1, 3); 
recording the captured information (information extracting from digital video data 201 and 
data generating by analyzer 240); storing the recorded information on a storage device (data 
segment 230 and secondary data 238, Fig 2), and analyzing the recorded information 
(analyzing synthesizer 200, Fig 1) (col. 2, lines 21-58, col. 3, lines 4-47, and lines 63-67, and 
col. 4, lines 1-30). 

7. Claim 18 is rejected under 35 U.S.C. § 103(a) as being unpatentable over Waters in view of 
Houvener, and further in view of Brunetti (US 6,507,278). 
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Regarding claim 18, the limitations of claim 1 are taught above, Brunetti discloses the 
interaction is associated with a baggage item (a passenger and luggage pass the screening) 
(col. 5 line 49 to col. 6, line 8, Brunetti). 

Thus, it would have been obvious to one of ordinary skill in the art to have included the 
interaction of association with a baggage item as taught by Brunetti into Houvener and 
Waters' system, as the combination yields a systematic process to increase the likelihood of 
detecting a known high-risk baggage, and minimizes the number of false positive 
identifications, thus provides a safeguard that ensures that luggage of each traveler is on the 
plane, and that the luggage is later claimed by the correct person. 

Conclusion 

8. The prior art made of record and not relied upon is considered pertinent to applicant's 
disclosure. 

- Kinoshita et al. (US 2002/0193973) disclose a passenger moving space guide 
system for guiding a large number of passengers who gather in a facility in a 
certain time and for providing various kinds of necessary information for the 
passengers. 

- Yagesh et al. (US 2003/0171939) disclose a system and method for monitoring 
and regulating the transportation of hazardous material. 

- Schoen et al. (US 7,231,355) disclose a system and method track both passenger 
and baggage during passenger trips, improving trip security, reducing lost 
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baggage, allowing remote baggage check-in and retrieval, and allowing billing 



and financial transactions among system users. 



Inquiries 



9. Any inquiry concerning this communication or earlier communications from the examiner 
should be directed to Kent Wang whose telephone number is 571-270-1703. The examiner 
can normally be reached on 8:00 A.M. - 5:30 PM (every other Friday off). 
If attempts to reach the examiner by telephone are unsuccessful, the examiner's supervisor, 
Ngoc Yen Vu can be reached on 571-272-7320. The fax phone number for the organization 
where this application or proceeding is assigned is 571-270-8300. 

Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published 
applications may be obtained from either Private PAIR or Public PAIR. Status information 
for unpublished applications is available through Private PAIR only. For more information 
about the PAIR system, see http://portal.uspto.gov/external/portal/pair. Should you have 
questions on access to the Private PAIR system, contact the Electronic Business Center 
(EBC) at 866-217-9197 (toll-free). If you would like assistance from a USPTO Customer 
Service Representative or access to the automated information system, call 800-786-9199 (IN 
USA OR CANADA) or 571-272-1000. 
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